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Priority Claim 

'"Tlirs--aEplication is a continuation-in-part of U.S. Patent Application Serial No. 
/09/5 18,492 titled ^ygt^q^md Method for Programmatically Creating a Graphical 
Program", filed March 3, 2000, whosfe^^j^ntors were Ram Kudukoli, Robert Dye, Melanie 
5 Jensen, and Yumiko Kawachi, which claims b^tie&of priority of U.S. provisional Patent 
Application Serial No. 60/149,943 titled "System and'TVfet^od for Programmatically 
Creating a Graphical Program" and filed August 19, 1999. 

This is also a continuation-in-part of U.S. Patent Apphcation Serial No. 09/595,003 
titled "System and Method for Automatically Generating a Graphical Program to 
10 Implement a Prototype", filed June 13, 2000, whose inventors were Nicolas Vazquez, 
Jeffirey L. Kodosky, Ram Kudukoli, Kevin L. Schultz, Dinesh Nair, Christophe Caltagirone. 

Field of the Invention 

The present invention relates to the field of graphical programming, and more 
15 particularly to a system and method for programmatically generating a graphical program 
in response to program information specifying fiinctionaUty of the graphical program. 



^ Description of the Related Art 

^ q/K^^ '^ii^^om[\y, high level text-based programming languages have been used by 
20 programmers in wnting^^application programs. Many different high level programming 
languages exist, including BASIt:^C4ava, FORTRAN, Pascal, COBOL, ADA, APL, etc. 
Programs written in these high level languages'af€;^franslated to the machine language level 
by translators known as compilers or interpreters. The mgh4^1 programming languages 
in this level, as well as the assembly language level, are referred tSSi^rein as text-based 
25 programming environments. 

Licreasingly, computers are required to be used and programmed by those who are 
not highly trained in computer programming techniques. When traditional text-based 
programming environments are used, the user's programming skills and ability to interact 
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with the computer system often become a Imiiting factor in the achievement of optimal 
utilization of the computer system. 

There are numerous subtle complexities which a user must master before he can 
efficiently program a computer system in a text-based environment. The task of 
5 programming a computer system to model or implement a process often is fiirther 
complicated by the fact that a sequence of mathematical formulas, mathematical steps or 
other procedures customarily used to conceptually model a process often does not closely 
correspond to the traditional text-based programming techniques used to program a 
computer system to model such a process. Li other words, the requirement that a user 

10 program in a text-based programming environment places a level of abstraction between the 
user's conceptualization of the solution and the implementation of a method that 
accomplishes this solution in a computer program. Thus, a user often must substantially 
master different skills in order to both conceptualize a problem or process and then to 
program a computer to implement a solution to the problem or process. Since a user often 

15 is not fiilly proficient in techniques for programming a computer system in a text-based 
environment to implement his solution, the efficiency with which the computer system can 
be utilized often is reduced. 

Examples of fields in which computer systems are employed to interact with 
physical systems are the fields of instrumentation, process control, industrial automation, 

20 and simulation. Computer measurement and control of devices such as instruments or 
industrial automation hardware has become increasingly desirable in view of the increasing 
complexity and variety of instruments and devices available for use. However, due to the 
wide variety of possible testing and control situations and environments, and also the wide 
array of instruments or devices available, it is often necessary for a user to develop a custom 

25 program to control a desired system. 

As discussed above, computer programs used to control such systems traditionally 
had to be written in text-based programming languages such as, for example, assembly 
language, C, FORTRAN, BASIC, etc. Traditional users of these systems, however, often 
were not highly trained in programming techniques and, in addition, text-based 
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programming languages were not sufficiently intuitive to allow users to use these languages 
without training. Therefore, implementation of such systems frequently required the 
involvement of a programmer to write software for control and analysis of instrumentation 
or industrial automation data. Thus, development and maintenance of the software 
5 elements in these systems often proved to be difficult. 

■ .^i=tK.-S,tg^. 4,901,221; 4,9.4,568; 5.291,587; 5.301,301; and 5,301.336; 
among others, to Kodosky-€t^ disclose a graphical system and method for modeling a 
process, i.e., a graphical programmmg^nvironment which enables a user to easily and 
intuitively model a process. The graphical pmg^amining environment disclosed in 

10 Kodosky et al can be considered a higher and more intuitiw^^^^ in which to interact with a 
computer. A graphically based programming environment can be^e^esented at a level 
above text-based high level programming languages such as C, Basic, Java, et 

The method disclosed in Kodosky et al allows a user to construct a diagram using a 
block diagram editor. The block diagram may include a plurality of interconnected icons 

15 such that the diagram created graphically displays a procedure or method for accomplishing 
a certain result, such as manipulating one or more input variables and/or producing one or 
more output variables. The diagram may have one or more of data flow, control flow 
and/or execution flow representations. Li response to the user constructing a diagram or 
graphical program using the block diagram editor, data structures may be automatically 

20 constructed which characterize an execution procedure which corresponds to the displayed 
procedure. The graphical program may be compiled or interpreted by a computer. 

Therefore, Kodosky et al teaches a graphical programming environment wherein a 
user places or manipulates icons and interconnects or "wires up" the icons in a block 
diagram using a block diagram editor to create a graphical "program." A graphical program 

25 for measuring, controlling, or modeling devices, such as instruments, processes or industrial 
automation hardware, or for modehng or simulating devices, may be referred to as a virtual 
instrument (VI). Thus, a user can create a computer program solely by using a graphically 
based programming environment. This graphically based programming environment may 
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be used for creating virtual instrumentation systems, modeling processes, control, 
simulation and numerical analysis, as well as for any type of general programming. 

In creating a graphical program, a user may create a front panel or user interface 
panel. The front panel may include various user interface elements or front panel objects, 
5 such as controls and/or indicators, that represent or display the respective input and output 
that will be used by the graphical program or VI, and may include other icons which 
represent devices being controlled. The front panel may be comprised in a single window 
of user interface elements, or may comprise a plurality of individual windows each having a 
user interface element, wherein the individual windows may optionally be tiled together. 

10 When the controls and indicators are created in the front panel, corresponding icons or 
terminals may be automatically created in the block diagram by the block diagram editor. 
Alternatively, the user can place terminal icons in the block diagram which may cause the 
display of corresponding front panel objects in the front panel, either at edit time or later at 
run time. As another example, the front panel objects, e.g., the GUI, may be embedded in 

1 5 the block diagram. 

During creation of the block diagram portion of the graphical program, the user may 
select various fimction nodes or icons that accomplish his desired result and connect the 
ftinction nodes together. For example, the function nodes may be connected in one or more 
of a data flow, control flow, and/or execution flow format. The function nodes may also be 

20 connected in a "signal flow" format, which is a subset of data flow. The function nodes 
may be connected between the terminals of the various user interface elements, e.g., 
between the respective controls and indicators. Thus the user may create or assemble a 
graphical program, referred to as a block diagram, graphically representing the desired 
process. The assembled graphical program may be represented in the memory of the 

25 computer system as data structures. The assembled graphical program, i.e., these data 
structures, may then be compiled or interpreted to produce machine language that 
accomplishes the desired method or process as shown in the block diagram. 

Input data to a graphical program may be received from any of various sources, such 
as from a device, unit under test, a process being measured or controlled, another computer 
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program, or from a file. Also, a user may input data to a graphical program or virtual 
instrument using front panel controls. This input data may propagate through the data flow 
block diagram or graphical program and appear as changes on the output indicators. In an 
instrumentation application, the front panel can be analogized to the front panel of an 
5 instrument. In an industrial automation application the front panel can be analogized to the 
MMI (Man Machine Interface) of a device. The user may adjust the controls on the front 
panel to affect the input and view the output on the respective indicators. Alternatively, the 
front panel may be used merely to view the input and output, or just the output, and the 
input may not be interactively manipulable by the user during program execution. 

10 Thus, graphical programming has become a powerfiil tool available to 

programmers. Graphical programming environments such as the National Instruments 
Lab VIEW product have become very popular. Tools such as Lab VIEW have greatly 
increased the productivity of programmers, and increasing numbers of programmers are 
using graphical programming environments to develop their software applications. In 

15 particular, graphical programming tools are being used for test and measurement, data 
acquisition, process control, man machine interface (MMI), supervisory control and data 
acquisition (SCADA) applications, simulation, machine vision applications, and motion 
control, among others. 

As graphical programming environments have matured and grown in popularity 

20 and complexity, it has become increasingly desirable to provide high-level tools which 
help a user create a graphical program. It also becomes increasingly desirable to integrate 
graphical programming environments with other applications and programming 
environments. In order to provide the desired tools or the desired integration, it would be 
greatly desirable to provide the ability to dynamically or programmatically generate a 

25 graphical program or a portion of a graphical program. For example, for various 
applications, it would be desirable to provide various types of program information to a 
program, wherein the program information specifies fimctionality of a graphical program 
(or portion of a graphical program) to be programmatically generated. 
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As described above, a user typically creates a graphical program within a 
graphical programming environment by interactively or manually placing icons or nodes 
representing the desired blocks of functionality on a diagram, and connecting the 
icons/nodes together to represent one or more of the data flow, control flow, and/or 
5 execution flow of the program. The ability to programmatically generate a graphical 
program in response to program information would enable a graphical program to 
automatically be generated without this type of interactive user input. 
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Summary of the Invention 

One embodiment of the present invention comprises a system and method for 
programmatically generating a graphical program or a portion of a graphical program, in 
response to receiving program information. The program information may specify 
5 functionality of the graphical program or graphical program portion to be generated. A 
graphical program generation program, referred to herein as a "GPG program", may be 
executed, wherein the GPG program may be operable to receive the program information. 
As discussed below, the program information may comprise any type of information that 
specifies functionality of or aspects of the graphical program desired to be created. In 

10 response to the program information, the GPG program may programmatically generate a 
graphical program (or graphical program portion) that implements the specified 
functionality. Thus, the GPG program may generate different graphical programs, 
depending on the program information received. 

In programmatically generating a graphical program, the GPG program may 

15 programmatically generate a block diagram portion comprising a plurality of connected 
icons or nodes, wherein the connected icons or nodes may visually or graphically indicate 
the functionality of the graphical program. The GPG program may also 
programmatically generate a user interface panel or front panel which may be used to 
provide input to and/or display output from the graphical program. For example, the 

20 GPG program may be constructed to programmatically generate one or more of a 
Lab VIEW program, a VEE program, a Simulink program, etc. 

The GPG program that generates the graphical program may be constructed using 
any of various programming languages, methodologies, or techniques. For example, the 
GPG program may itself be a graphical program, or the GPG program may be a text- 

25 based program, or the GPG program may be constructed using a combination of graphical 
and text-based programming environments. 

Also, the GPG program may have any of various purposes or applications. In 
some embodiments, the GPG program may include or be associated with a program or 
application which a user utilizes to construct or characterize a computational process. In 
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response to the specified computational process, the GPG program may be used to 
programmatically generate a graphical program to implement the computational process. 
For example, in one embodiment a state diagram editor program may be used to construct 
a state diagram characterizing a computational process, in response to user input. The 
5 GPG program may then be executed, wherein the GPG program receives information on 
the state diagram and programmatically generates a graphical program that implements 
functionality specified by the state diagram. As another example, a prototyping 
application may be used by the user to construct a prototype, e.g., in order to characterize 
an algorithm at a high level. Li this case, the GPG program may then receive information 

10 on the prototype and programmatically generate a graphical program that implements the 
prototype. As another example, a test executive program may be executed which enables 
the user to construct a test executive sequence, e.g., to perform a series of tests on a unit 
under test. In this case, the GPG program may then programmatically generate a 
graphical program operable to perform the series of tests when executed. 

15 In other embodiments, the GPG program may include or be associated with a 

program or application that directly aids the user in creating a graphical program. For 
example, the GPG program may be included in a graphical programming development 
application. In this case the graphical programming development application may be 
operable to receive user input specifying desired functionality and the GPG program may 

20 automatically, i.e., programmatically, add a portion of graphical program code 
implementing the specified fimctionality to the user's program. The user input may be 
received, for example, via one or more "wizard" user interface dialogs enabling the user 
to specify various options. Such graphical program code generation wizards may greatly 
simplify the user's task of implementing various operations. As an example, it is often 

25 difficult for developers of instrumentation applications to properly implement code to 
analyze an acquired signal, due to the inherent complexity involved. By enabling the 
developer to easily specify the desired functionality through a high-level user interface, 
the GPG program can receive this information and automatically create graphical code to 
implement the signal analysis. Furthermore, since the graphical code is generated 
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programmatically, the code may be optimized, resulting in an efficient program and a 
readable block diagram without unnecessary code. 

In other embodiments, the GPG program may be a program or application 
operable to automatically or programmatically translate an existing program into a 
5 graphical program. The GPG program may examine the existing program and 
programmatically generate a graphical program that performs the same or substantially 
the same functionaUty, or performs a portion of the functionality, of the existing program. 
In one embodiment, the existing program may be a text-based program, such as a C 
program. In another embodiment, the existing program may itself be a graphical 

10 program. For example, although graphical programs created using different graphical 
programming environments are similar in some respects, the graphical programs typically 
cannot be easily transferred across different graphical programming environments for 
editing or execution. For example, different graphical programming environments 
provide different nodes for inclusion in a block diagram, store program files in different 

15 formats, etc. Thus, if an existing graphical program associated with one programming 
environment is desired to be ported to a new programming environment, in the current 
prior art this would have to be done manually. According to one embodiment of the 
invention, the GPG program may examine the existing graphical program (or may 
examine abstract information specifying the existing graphical program) and may 

20 programmatically generate a new graphical program associated with the new 
programming environment. 

In addition to the examples given above, a GPG program may receive any other 
type of information and programmatically generate a graphical program based on the 
received information. It is noted that, in various embodiments, the GPG program may 

25 receive the information used in generating the graphical program in any of various ways. 
The information may be received from the user, fi-om another program, or fi-om other 
sources, such as a file or database. 

The information may comprise information of any type, including text or binary 
information structured in any of various ways. The information may be self-describing, 
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and/or the GPG program may include knowledge of how to interpret the information in 
order to generate the appropriate graphical program. The information may completely 
specify the functionality of the graphical program desired to be created, or may specify 
only a portion of the functionality of the graphical program desired to be created. In the 
5 latter instance the GPG program may not be able to create a completely functioning 
graphical program, but rather may only be able to create a portion or fragment of a 
graphical program. In this instance, the user may be expected to manually complete the 
graphical program. 

As an example, consider a state diagram editor program usable for constructing a 

10 state diagram. In this example, the GPG program may be the state diagram editor 
program itself or may be coupled with the state diagram editor program. For example, 
the state diagram editor program may receive user input specifying state diagram 
information. The state diagram editor program may then programmatically generate a 
graphical program to implement functionality specified by the state diagram information, 

15 e.g., in response to the user selecting a menu option to generate the graphical program. In 
other embodiments, the GPG program may be separate from the state diagram editor 
program. For example, when the user selects the menu option to generate the graphical 
program, the state diagram editor program may provide the state diagram information to 
the GPG program, which then generates the graphical program based on this information. 

20 In another embodiment, a user may invoke the GPG program separately and request the 
GPG program to generate a graphical program, e.g., by specifying a state diagram file. 
The GPG program may receive the state diagram information in any of various ways 
formats, e.g., as binary data, XML data, etc. 

In most of the examples given above, functionality of the graphical program to be 

25 generated is specified explicitly by the received information. For example, a state 
diagram, user input specified via a wizard interface, a prototype, a test executive 
sequence, and an existing program, all explicitly specify, to varying degrees, functionality 
which the graphical program should implement. 
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In other embodiments the received information by itself may not exphcitly or 
inherently specify functionality of the graphical program to be generated. In a case such 
as this, the functionality of the generated graphical program may be determined mainly 
by the nature or type of the GPG program. For example, consider two different GPG 
5 programs, program A and program B, which are both operable to retrieve numeric data 
from a database and create a graphical program based on the numeric data. Program A 
may be operable to create a graphical program which, when executed, displays a user 
interface to visually graph the numeric data. For example, program A may receive user 
input specifying various display options desired and may programmatically generate the 

10 graphical program such that the graphical program is operable to display the numeric data 
as specified by the user. Program B, on the other hand, may be operable to create a 
graphical program which, when executed, performs a statistical analysis of the data and 
displays the result of the analysis. For example, program B may receive user input 
specifying various analysis options desired and may programmatically generate the 

15 graphical program such that the graphical program is operable to analyze the numeric 
data as specified by the user. Thus, in these examples, the functionality of the graphical 
program is determined mainly by the GPG program that generates the graphical program, 
and only determined to a small degree (or no degree) by the received information. 

Thus, in various embodiments, the functionality of the graphical program may be 

20 determined by the received information and/or the GPG program. In some cases the 
functionality may be specified almost entirely by the received information. For example, 
in a case where the GPG program programmatically translates an existing program to a 
new graphical program, the functionality of the new graphical program may be specified 
entirely by the existing program. In other cases, the received information and the GPG 

25 program may each determine a portion of the functionality. For example, in a case where 
the GPG program generates a graphical program to implement a test executive sequence, 
the test executive sequence information may determine the body of the program which 
includes the code for executing the tests, but the GPG program may be operable to add 
additional functionality to the graphical program, e.g., by adding code operable to prompt 
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the user for a log file and save test results to the log file, code to display a user interface 
indicating the current unit under test and the current test being performed, etc. 

In a typical case, the implementation of the graphical program code is determined 
mainly or entirely by the GPG program, although the received information may influence 
5 the manner in which the GPG program generates the code, or the GPG program may 
receive separate information influencing the code generation. For example, consider a 
GPG program operable to translate an existing graphical program to a new graphical 
program, e.g., in order to port the existing graphical program to a new programming 
environment, hi one embodiment, the GPG program may be operable to generate the 

10 new graphical program in such a way as to match the existing graphical program as 
closely as possible in appearance. In other words, the new graphical program may be 
generated so that when the user sees the block diagram of the new graphical program, the 
block diagram appears substantially the same as the block diagram of the existing 
graphical program, e.g., in terms of the layout and connections among the block diagram 

15 nodes. In a similar manner, the user interface or firont panel of the new graphical program 
may be programmatically created to closely resemble the user interface or front panel of 
the existing graphical program. In another embodiment, the GPG program may be 
operable to implement the new graphical program differently, e.g., by optimizing the 
code where possible. In this example, the functionality of the generated graphical 

20 program may be the same in either case, but the new graphical program may be 
implemented in a different way and have a different appearance than the existing 
graphical program. 

The GPG program may also receive input specifying how to implement the 
graphical program. For example, in the case above, the user may specify whether or not 
25 to perform optimizations when translating an existing graphical program. For example, 
the new programming environment may support downloading the generated graphical 
program to a hardware device for execution. If the user desires to download the 
generated graphical program to a hardware device, e.g., for use in a real-time application, 
then it may be important to optimize the new program. Otherwise, it may be more 
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important to implement the generated graphical program similar to how the existing 
graphical program is implemented. 

In one embodiment, the GPG program may provide extended support for 
specifying graphical program code implementation, beyond the ability to specify simple 
5 options. For example, the GPG program may support functionality or plug-ins specifying 
code generation information for various cases. Referring again to the program translation 
example above, each plug-in may specify how to generate code intended for execution on 
a particular hardware device. For example, if the generated program is to be run on an 
FPGA, the generation of the code may be optimized depending on the number of gates 

10 available on that particular FPGA. 

In various embodiments, an association between a generated graphical program 
and the received program information used in generating the graphical program may be 
maintained. For example, this association may enable a user to execute the automatically 
generated program and then return to an application from which the program information 

15 originates, e.g., in order to view or edit the program information. For example, consider a 
prototyping environment application which enables a user to develop a prototype 
characterizing an algorithm. The GPG program, which may be part of the prototyping 
environment application, may programmatically generate a graphical program 
implementing the developed prototype. The user may then execute the graphical 

20 program, and if a problem with the program is discovered, the association may enable the 
user to retum to the prototyping environment application in order to view or modify the 
prototype used to generate the program. In one embodiment, a generated graphical 
program may be "locked", requiring the user to explicitly unlock the graphical program 
before the graphical program can be modified within the graphical programming 

25 environment. Locking the program may facilitate the retrieval or re-creation of the 
program information that was used to generate the program. 

In various embodiments, the GPG program may be operable to generate any of 
various types of graphical programs. For example, as discussed above, a generated 
graphical program may be targeted toward a particular graphical programming 



Atty. Dkt. No.: 5150-44100 



Page 13 



Conley, Rose & Tayon, P.C. 



development environment application. The GPG program may thus utilize proprietary 
features or create files that are formatted in a manner expected by the graphical 
progranmiing development environment. This may be desirable or necessary when the 
graphical programming development environment includes a runtime environment that is 
5 required for the created graphical program to execute. Examples of graphical 
programming development environments include Lab VIEW, Bridge VIEW, DasyLab, and 
DiaDem from National Instruments, VEE from Hewlett Packard, Simulink from The 
Math Works, Softwire from Measurement Computing, Inc., Sanscript from Northwoods 
Software, WiT from Coreco, and Vision Program Manager from PPT Vision, among 
10 others. 

In various embodiments, the graphical program may be generated using any of 
various methods or techniques. Generating the graphical program may comprise generating 
one or more files or data structures defining the graphical program. When a user 
interactively develops a graphical program from within a graphical programming 

15 environment, the graphical programming environment may create one or more program 
files. For example, the program files may specify information such as a set of nodes that 
the graphical program uses, interconnections among these nodes, programmatic structures 
such as loops, etc. In other cases, the program files may store various data structures, e.g., 
in binary form, which the graphical programming environment uses to directly represent the 

20 graphical program. Thus, in programmatically generating the graphical program, the GPG 
program may programmatically generate one or more files or data structures representing 
the graphical program, wherein these files may be structured or formatted appropriately for 
a particular graphical programming environment. 

In one embodiment, a graphical programming development environment may 

25 provide an application programming interface (API) which the GPG program can use to 
programmatically generate the graphical program. For example, for each node, user 
interface element, or other object of the graphical program, the API may be called to 
programmatically add the object to the graphical program, connect the object to other 
objects of the graphical program, etc. Thus, any necessary files or other constructs needed 



Atty. Dkt. No.: 5150-44100 



Page 14 



Conley, Rose & Tayon, P.C. 




by the graphical programming environment in order to use the generated graphical program 
may be automatically created as a result of calling the API. Particular embodiments of such 
an API are discussed below. 

In various cases, a graphical program generated by a GPG program in response to 
5 program information may be a fully working program. Thus, the user may load the 
generated graphical program into the graphical programming environment, execute the 
program, etc. In other cases, the generated graphical program may not be a complete 
program. As an example, if an existing program is translated to a graphical program, it may 
not be possible to translate the entire program. For example, the existing program may 

10 utihze functions which do not exist in the graphical programming environment to which the 
program is to be ported. As another example, the received program information may 
specify functionality which does not exist in the graphical programming environment for 
which the new graphical program is being generated. However, the GPG program may still 
create a partial graphical program, making it relatively easy for the user to complete the 

15 graphical program. In still other cases, it may be desirable to programmatically generate 
only a graphical code portion, e.g., as discussed above in the case of user interface wizard 
tools that aid the user in program development. In one embodiment, the GPG program may 
programmatically generate a graphical program portion that relies on functionaUty that is 
supported in the target graphical programming environment in which the graphical program 

20 is being created. The GPG program may also include references in the created graphical 
program to outside libraries, such as C libraries, which implement the remaining portion of 
the functionality specified in the program information that could not be implemented 
directly in the created graphical program. 

25 
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Brief Description of the Drawings 

A better understanding of the present invention can be obtained when the 
following detailed description of the preferred embodiment is considered in conjunction 
5 with the following drawings, in which: 

Figure 1 illustrates a computer system connected through a network to a second 
computer system; 

10 Figures 2 A and 2B illustrate representative instrumentation and process control 

systems including various I/O interface options; 

Figure 3 is a block diagram of the computer system of Figures 1, 2 A and 2B; 

15 Figure 4 is a flowchart diagram illustrating one embodiment of a method for 

programmatically generating a graphical program in response to receiving program 
information; 

Figure 5 is a block diagram illustrating that a "GPG program" which 
20 programmatically generates a graphical program may be a program for any of various 
purposes and may receive information of any type to use in generating the graphical 
program; 

Figure 6 is a block diagram illustrating the abstract relationship between a client 
25 program (a GPG program), an API to programmatically generate/edit a graphical 
program, and a server program; 



Atty. Dkt No.: 5150-44100 



Page 16 



Conley, Rose & Tayon, P.C. 




Figures 7-17 illustrate graphical program nodes that may be included in a 
graphical GPG program in order to programmatically generate or modify a graphical 
program; 

5 Figure 18 illustrates user interface controls which may be placed on a front panel 

in order to interactively obtain a reference to a server program or a graphical program to 
edit; 

Figures 19 and 20 illustrate how a user may select graphical program objects to 
10 create or edit by choosing from hierarchical menus; 

Figure 21 and 22 illustrate a user interface and block diagram, respectively, of an 
exemplary graphical program; and 

15 Figure 23 (Figures 23 A - 23D) illustrates a client graphical program that creates 

the graphical program of Figures 21 and 22. 

While the invention is susceptible to various modifications and alternative forms 
specific embodiments are shown by way of example in the drawings and are herein 
20 described in detail. It should be understood however, that drawings and detailed 
description thereto are not intended to limit the invention to the particular form disclosed, 
but on the contrary the invention is to cover all modifications, equivalents and alternative 
following within the spirit and scope of the present invention as defined by the appended 
claims. 
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Detailed Description of the Preferred Embodiments 

Incorporation by Reference 

The following references are hereby incorporated by reference in their entirety as 
5 though fully and completely set forth herein. 

U.S. Patent No. 5,481,741 titled "Method and Apparatus for Providing Attribute 
Nodes in a Graphical Data Flow Environment," issued on January 2, 1996. 

U.S. Patent No. 6,064,812 titled "System and Method for Developing Automation 
10 Clients Using a Graphical Data Flow Program," issued on May 16, 2000. 

U.S. Patent No. 6,102,965 titled "System and Method for Providing Chent/Server 
Access to Graphical Programs," issued on August 15, 2000. 

U.S. Patent Apphcation Serial No. 09/136,123 titled "System and Method for 
Accessing Object Capabilities in a Graphical Program" filed August 18, 1998. 
15 U.S. Patent AppHcation Serial No. 09/518,492 titled "System and Method for 

Programmatically Creating a Graphical Program", filed March 3, 2000. 

U.S. Patent AppHcation Serial No. 09/595,003 titled "System and Method for 
Automatically Generating a Graphical Program to Implement a Prototype," filed June 13, 
2000. 

20 U.S. Patent Application Serial No. 08/912,445 titled "Embedded Graphical 

Programming System" filed on August 18, 1997, whose inventors were Jeffrey L. Kodosky, 

Darshan Shah, Samson DeKey, and Steve Rogers. 

U.S. Patent AppHcation Serial No. 08/912,427 titled "System and Method for 

Converting Graphical Programs Into Hardware Implementations" filed on August 18, 1997, 
25 whose inventors were Jeffrey L. Kodosky, Hugo Andrade, Brian Keith Odom, and Cary 

Paul Butler. 

Figure 1 - Computer System Connected to a Network 
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Figure 1 illustrates an exemplary computer network in which a computer system 82 
is connected through a network 84 to a second computer system 86. The computer system 
82 and the second computer system 86 can be any of various types, as desired. The network 
84 can also be any of various types, including a LAN (local area network), WAN (wide area 
5 network), or the Internet, among others. 

The computer system 82 may include or store a computer program, referred to 
herein as a graphical program generation program, or a "GPG program'*, that is operable to 
receive program information and programmatically generate a graphical program based on 
the program information. One embodiment of a method for programmatically generating a 

1 0 graphical program is described below. 

In one embodiment, the GPG program may be implemented as a self-contained 
program or application that includes all necessary program logic for generating the 
graphical program. In another embodiment, the GPG program may comprise a cUent 
portion and a server portion (or client program and server program), wherein the client 

15 portion may request or direct the server portion to generate the graphical program. For 
example, the client portion may utilize an application programming interface (API) 
provided by the server portion in order to generate the graphical program. In other words, 
the client portion may perform calls to the API provided by the server portion, and the 
server portion may execute fimctions or routines bound to these calls to generate the 

20 graphical program. In one embodiment, the server portion may be an instance of a 
graphical programming environment application. For example, the Lab VIEW graphical 
programming environment application enables client programs to interface with a 
Lab VIEW server in order to programmatically generate or modify graphical programs. 

As used herein, the term "GPG program" is intended to include any of various 

25 implementations of a program (or programs) that are executable to programmatically 
generate a graphical program based on received program information. For example, the 
term "GPG program" is intended to include an embodiment in which the GPG program is a 
self-contained program or application (not implemented as a client/server program) that 
includes all necessary program logic for programmatically generating a graphical program. 
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The term "GPG program" is also intended to include an embodiment in which a 
combination of a client portion (or client program) and server portion (or server program) 
operate together to programmatically generate the graphical program. The term "GPG 
program" is also intended to include other program implementations. 
5 In an embodiment in v^hich a client program interfaces v^ith a server program to 

generate the graphical program, the server program may execute on the same computer 
system as the client program or may execute on a different computer system, e.g., a 
different computer system connected via a network. For example, in Figure 1, the client 
program may execute on the computer system 82, and the server program may execute on 
10 the computer system 86. Li this case, the graphical program, e.g., files representing the 
graphical program may be created on the computer system 82, or 86, or on a different 
computer system. 

It is noted that the GPG program may be implemented using any of various 
programming technologies or methodologies. Where the GPG program is implemented as 

15 client and server programs, each of these programs may utilize procedure-based 
techniques, component-based techniques, and/or object-oriented techniques, among 
others. The programs may be written using any combination of text-based or graphical 
programming languages. Also, the programs may be vmtten using distributed modules or 
components so that each program may reside on any combination of computer system 82, 

20 computer system 86, and other computer systems connected to the network 84. Also, in 
various embodiments, the client program may interface with the server program through a 
proxy software component or program. 

25 Figures 2A and 2B - Instrumentation and Industrial Automation Systems 

Figures 2A and 2B illustrate exemplary systems which may store or use a GPG 
program and/or a server program which are operable to programmatically generate a 
graphical program. Also, these systems may execute a programmatically generated 
graphical program. For example, the graphical program may perform an instrumentation 
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function, such as a test and measurement function or an industrial automation function. It is 
noted that the GPG program, the server program, and/or a generated graphical program may 
be stored in or used by any of various other types of systems as desired and may implement 
any function or application as desired. Thus, Figures 2A and 2B are exemplary only. 
5 Figure 2 A illustrates an exemplary instrumentation control system 100. The system 

100 comprises a host computer 102 which connects to one or more instruments. The host 
computer 102 may comprise a CPU, a display screen, memory, and one or more input 
devices such as a mouse or keyboard as shov/n. The computer 102 connects through the 
one or more instruments to analyze, measure, or control a unit under test (UUT) or process 

10 150. Li one embodiment, the computer 102 may be either of the computers 82 or 86 shown 
in Figure 1, which as described above are operable to programmatically generate graphical 
programs based on received information. Also, in one embodiment, the computer 102 may 
execute a generated graphical program, such as a graphical program that controls or models 
one or more of the connected instruments. 

15 The one or more instruments may include one or more of a GPIB instrument 112 

and associated GPIB interface card 122, a data acquisition board 114 and associated signal 
conditioning circuitry 124, a VXI instrument 1 16, a PXI instrument 1 18, a video device 132 
and associated image acquisition card 134, a motion control device 136 and associated 
motion control interface card 138, and/or one or more computer based instrument cards 142, 

20 among other types of devices. 

The GPIB instrument 112 may be coupled to the computer 102 via the GPIB 
interface card 122 comprised in the computer 102. In a similar manner, the video device 
132 may be coupled to the computer 102 via the image acquisition card 134, and the motion 
control device 136 may be coupled to the computer 102 through the motion control 

25 interface card 138. The data acquisition board 114 may be coupled to the computer 102, 
and may interface through signal conditioning circuitry 124 to the UUT. The signal 
conditioning circuitry 124 preferably comprises an SCXI (Signal Conditioning extensions 
for Instrumentation) chassis comprising one or more SCXI modules 126. 
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The GPIB card 122, the image acquisition card 134, the motion control interface 
card 138, and the DAQ card 1 14 are typically plugged in to an I/O slot in the computer 102, 
such as a PCI bus slot, a PC Card slot, or an ISA, EISA or MicroChannel bus slot provided 
by the computer 102. However, these cards 122, 134, 138 and 114 are shown extemal to 
5 computer 102 for illustrative purposes. 

The VXI chassis or instrument 116 may be coupled to the computer 102 via a VXI 
bus, MXI (e.g., MXI-3) bus, or other serial or parallel bus provided by the computer 102. 
The computer 102 preferably includes VXI interface logic, such as a VXI, MXI or GPIB 
interface card (not shown), which interfaces to the VXI chassis 116. The PXI chassis or 
10 instrument is preferably coupled to the computer 102 through the computer's PCI bus. 

A serial instrument (not shown) may also be coupled to the computer 102 through a 
serial port, such as an RS-232 port, USB (Universal Serial bus) or IEEE 1394 or 1394.2 
bus, provided by the computer 102. 

In typical instrumentation control systems an instrument will not be present of each 
15 interface type, and in fact many systems may only have one or more instruments of a single 
interface type, such as only GPIB instruments. The one or more instruments are coupled to 
the unit under test (UUT) or process 150, or are coupled to receive field signals, typically 
generated by transducers. The system 100 may be used in a data acquisition and control 
application, in a test and measurement application, a process control appUcation, or a man- 
20 machine interface application. 

Figure 2B illustrates an exemplary industrial automation system 160. The industrial 
automation system 160 is similar to the instrumentation or test and measurement system 
100 shown in Figure 2 A. Elements which are similar or identical to elements in Figure 2 A 
25 have the same reference numerals for convenience. The system 160 may comprise a 
computer 102 which connects to one or more devices or instruments. The computer 102 
may comprise a CPU, a display screen, memory, and one or more input devices such as a 
mouse or keyboard as shown. The computer 102 may connect through the one or more 
devices to a process or device 150 to perform an automation function, such as MMI (Man 
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Machine Interface), SCADA (Supervisory Control and Data Acquisition), portable or 
distributed data acquisition, process control, advanced analysis, or other control. In one 
embodiment, the computer 102 may be either of the computers 82 or 86 shovra in Figure 1, 
v/hich as described above are operable to programmatically generate graphical programs 
5 based on received information. Also, in one embodiment, the computer 102 may execute a 
generated graphical program, such as a graphical program that is involved with the 
automation function performed by the automation system 160. 

The one or more devices may include a data acquisition board 114 and associated 
signal conditioning circuitry 124, a PXI instrument 118, a video device 132 and associated 

10 image acquisition card 134, a motion control device 136 and associated motion control 
interface card 138, a fieldbus device 170 and associated fieldbus interface card 172, a PLC 
(Programmable Logic Controller) 176, a serial instrument 182 and associated serial 
interface card 184, or a distributed data acquisition system, such as the Fieldpoint system 
available from National Instruments, among other types of devices. 

15 The DAQ card 114, the PXI chassis 118, the video device 132, and the image 

acquisition card 136 are preferably connected to the computer 102 as described above. The 
serial instrument 182 is coupled to the computer 102 through a serial interface card 184, or 
through a serial port, such as an RS-232 port, USB, or IEEE 1394 or 1394.2 provided by the 
computer 102. The PLC 176 couples to the computer 102 through a serial port, Ethernet 

20 port, or a proprietary interface. The fieldbus interface card 172 is preferably comprised in 
the computer 102 and interfaces through a fieldbus network to one or more fieldbus devices. 
Each of the DAQ card 1 14, the serial card 184, the fieldbus card 172, the image acquisition 
card 134, and the motion control card 138 are typically plugged in to an I/O slot in the 
computer 102 as described above. However, these cards 114, 184, 172, 134, and 138 are 

25 shown extemal to computer 102 for illustrative purposes. In typical industrial automation 
systems a device will not be present of each interface type, and in fact many systems may 
only have one or more devices of a single interface type, such as only PLCs. The devices 
are coupled to the device or process 150. 
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Referring again to Figures 2 A and 2B, the computer system(s) 102 preferably 
includes a memory medium(s) on which one or more computer programs or software 
components according to one embodiment of the present invention are stored. For example, 
the memory mediimi may store a GPG program which is executable to receive program 
5 information and programmatically generate a graphical program based on the information. 
The same or a different memory medium may also store a server program with which a 
client portion of the GPG program interfaces in order to generate the graphical program. 
The memory medium may also store a programmatically generated graphical program. The 
memory medium may also store a graphical programming development application 

10 operable execute or edit the programmatically generated graphical program. It is noted that 
various of these software programs may be stored on different computer systems, as 
described above with reference to Figure 1. Also, in various embodiments, various of the 
above software programs may be implemented or combined in different ways. For 
example, a graphical programming development application may implement the server 

15 program with which a cUent program interfaces to programmatically generate a graphical 
program. 

The term "memory medium" is intended to include an installation medium, e.g., a 
CD-ROM, floppy disks 104, or tape device, a computer system memory or random access 
memory such as DRAM, SRAM, EDO RAM, Rambus RAM, etc., or a non-volatile 

20 memory such as a magnetic media, e.g., a hard drive, or optical storage. The memory 
medium may comprise other types of memory as well, or combinations thereof 

In addition, the memory medium may be located in a first computer in which the 
programs are executed, or may be located in a second different computer which connects to 
the first computer over a network, such as the Intemet. In the latter instance, the second 

25 computer may provide the program instructions to the first computer for execution. Also, 
the computer system 102 may take various forms, including a personal computer system, 
mainframe computer system, workstation, network appliance, Intemet appliance, personal 
digital assistant (PDA), television system or other device. In general, the term "computer 
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system" can be broadly defined to encompass any device having at least one processor 
which executes instructions fi-om a memory medium. 

In one embodiment, the GPG program and/or the resulting graphical program that is 
5 programmatically generated may be designed for data acquisition/generation, analysis, 
and/or display, and for controlling or modeling instrumentation or industrial automation 
hardware. For example, in one embodiment, the National Instruments Lab VIEW graphical 
programming development application, which provides specialized support for developers 
of instrumentation appUcations, may act as the server program. In this embodiment, the 

10 client program may be a software program that receives and processes program information 
and invokes functionality of the Lab VIEW graphical programming environment. The client 
program may also be a program involved with instrumentation or data acquisition. 

However, it is noted that the present invention can be used for a plethora of 
applications and is not limited to instrumentation or industrial automation applications. In 

15 other words, Figures 2 A and 2B are exemplary only, and graphical programs for any of 
various types of purposes may be generated by a GPG program designed for any of various 
types of purposes, wherein the programs are stored in and execute on any of various types 
of systems. Various examples of GPG programs and generated graphical programs are 
discussed below. 

20 

Figure 3 - Computer System Block Diagram 

Figure 3 is a block diagram of the computer system illustrated in Figures 1, 2 A and 
2B. It is noted that any type of computer system configuration or architecture can be used 
25 as desired, and Figure 3 illustrates a representative PC embodiment. It is also noted that the 
computer system may be a general purpose computer system as shown in Figures 2A and 
2B, a computer implemented on a VXI card installed in a VXI chassis, a computer 
implemented on a PXI card installed in a PXI chassis, or other types of embodiments. The 
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elements of a computer not necessary to understand the present invention have been 
omitted for simplicity. 

The computer 102 includes at least one central processing unit or CPU 160 which 
is coupled to a processor or host bus 162. The CPU 160 may be any of various types, 
5 including an x86 processor, e.g., a Pentium class, a PowerPC processor, a CPU from the 
SPARC family of RISC processors, as well as others. Main memory 166 is coupled to 
the host bus 162 by means of memory controller 164. 

The main memory 166 may store computer programs according to one 
embodiment of the present invention. The main memory 166 also stores operating 

10 system software as well as the software for operation of the computer system, as well 
known to those skilled in the art. The computer programs of the present invention will be 
discussed in more detail below. 

The host bus 162 is coupled to an expansion or input/output bus 170 by means of 
a bus controller 168 or bus bridge logic. The expansion bus 170 is preferably the PCI 

15 (Peripheral Component Interconnect) expansion bus, although other bus types can be 
used. The expansion bus 170 includes slots for various devices such as the data 
acquisition board 114 (of Figure 2 A) and a GPIB interface card 122 which provides a 
GPIB bus interface to the GPIB instrument 112 (of Figure 2 A). The computer 102 
fixrther comprises a video display subsystem 180 and hard drive 182 coupled to the 

20 expansion bus 1 70. 

As shown, a reconfigurable instrument 190 may also be connected to the 
computer 102. The reconfigurable instrument 190 may include configurable logic, such 
as a programmable logic device (PLD), e.g., an FPGA, or a processor and memory, which 
may execute a real time operating system. According to one embodiment of the 

25 invention, a programmatically generated graphical program may be downloaded and 
executed on the reconfigurable instrument 190. For example, a graphical programming 
environment with which the graphical program is associated may provide support for 
downloading a graphical program for execution on configurable logic in a real time 
system. In various embodiments, the configurable logic may be comprised on an 
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instrument or device connected to the computer through means other than an expansion 
slot, e.g., the instrument or device may be connected via an IEEE 1394 bus, USB, or 
other type of port. Also, the configurable logic may be comprised on a device such as the 
data acquisition board 1 14 or another device shown in Figure 2 A. 



Figure 4 - Programmatic Creation of a Graphical Program 

In prior systems, a user interactively or manually creates or edits a graphical 
program. For example, the user may interactively add various objects or icons to a 

10 graphical program block diagram, connect the objects together, etc. In contrast, one 
embodiment of the present invention comprises a system and method for 
programmatically generating a graphical program (or portion of a graphical program) 
. wkhout requiring this type of user interaction. 

K^gure 4 is a flowchart diagram illustrating one embodiment of a method for 

15 programmanis;ally generating a graphical program. In step 200, a graphical program 
generation (GPG^^^^program may be created, wherein the GPG program is operable to 
programmatically gen^ate a plurality of graphical programs, based on received 
information. As described bfel<jw, the GPG program may be associated with any of 
various purposes or applications. as discussed above, the GPG program may be 

20 implemented in various ways, e.g., usin^symraphical and/or text-based programming 
environments. For example, the GPG program m^ be a text-based program, such as a 
program written using C, C++, Java, Basic, Visual Bask. FORTRAN, Pascal, or another 
text-based programming language. Also, the GPG prograiiKmay itself be a graphical 
program. For example, the GPG program may be a graphical pi;p gram interactively 

25 created in response to user input. 

As described below, the GPG program may be implemented based on a 
client/server programming model. The client portion may call an application 
programming interface (API) provided by the server portion usable for programmatically 
creating the new graphical program. For example, a text-based GPG program may 
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include text-based code for calling various API functions or methods, while a graphical 
GPG program may include various graphical nodes which are operable to invoke 
functions of the API. The creation of the GPG program may be performed by a 
developer, wherein the GPG program may be used as a tool for the programmatic creation 
5 of graphical programs by users or other developers. 

As shown in step 204, program information for the new graphical program (or 
graphical program portion) to be generated may be specified, e.g., in response to user 
input. As described below, this program information may comprise any of various types 
of information and may specify functionality of the new graphical program. 

10 In step 206, the GPG program may be executed. The GPG program may be 

executed in any type of computer system. 

In step 208, the GPG program may receive the program information specifying 
the functionality for the graphical program or graphical program portion. As described 
below, the GPG program may receive any type of information from any type of source. 

15 In step 210, the GPG program may programmatically generate a graphical 

program or graphical program portion to implement the functionality specified by the 
received information. In other words, in response to receiving the information in step 
208, the GPG program may programmatically generate a new graphical program based on 
the information. The graphical program may be programmatically generated with little or 

20 no user input received during this creating. In one embodiment, the graphical program is 
programmatically generated with no user input required. In another embodiment, the user 
may be prompted for certain decisions during programmatic generation, such as the type 
of graphical program, the look and feel of a user interface for the graphical program, the 
number or degree of comments contained within the graphical program, etc. 

25 In response to receiving the information in step 208, the GPG program may 

process the information in order to determine how to generate the graphical program, i.e., 
in order to determine appropriate graphical source code for the program, an appropriate 
user interface for the program, etc. As described below, the determination of how to 
generate the graphical program may depend on a combination of the received information 
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and/or the program logic of the GPG program (i.e., what the GPG program is operable to 
do with the received information). 

In generating the determined graphical program, the GPG program may specify 
the inclusion of various objects in the new graphical program. For example, the new 
5 graphical program may have a diagram portion including a plurality of interconnected 
nodes which visually indicate functionality of the new graphical program. The new 
graphical program may also have a user interface portion including various user interface 
objects, such as one or more user interface panels having controls for specifying user 
input to the graphical program and/or indicators for displaying output from the graphical 

10 program. The GPG program may also specify other aspects of the graphical program, 
such as: interconnections between diagram objects, connections between diagram objects 
and user interface objects, positions of objects, sizes of objects, and properties or 
configuration of objects (e.g., configuration of data types, parameters, etc.), among other 
aspects of the graphical program. 

15 Li various embodiments, the GPG program may generate a graphical program of 

any of various types. For example, the GPG program may generate the graphical 
program specifically so that a particular graphical programming development 
environment is operable to edit and/or execute the graphical program. 

In one embodiment, the GPG program may be a self-contained program that 

20 includes all executable logic necessary for programmatically generating the new 
graphical program. However, in the preferred embodiment, the GPG program utilizes a 
client/server programming model, in which the client portion processes the program 
information and determines the graphical program to be generated based on the program 
information (i.e., determines the function nodes or other objects to be included in the 

25 program , the interconnections among these nodes/objects, etc.). The client portion may 
then call an API provided by the server portion to request the server portion to perform 
the actual creation of the new graphical program, e.g., by creating files and/or other data 
structures representing the new graphical program. The server portion may execute on 
the same computer system as the client portion or may execute on a different computer 
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system, e.g., a different computer system comiected by a network. In one embodiment, 
the server portion may be an instance of a graphical programming development 
environment application, v^hich provides an API enabling client programs to 
programmatically create and/or edit graphical programs. 
5 The method of Figure 4 is illustrated and is described above in terms of 

generating a new graphical program. It is noted that a similar method may be used to 
modify an existing graphical program, e.g., in order to add functionality to the program, 
such as functionality specified by user input received by a user interface wizard. In other 
words, instead of specifying creation of a new graphical program, the GPG program may 

10 specify the modification of an existing graphical program. When executed, the GPG 
program is then operable to progranmiatically modify the existing graphical program. 
For example, the GPG program may include a reference to the existing graphical program 
and may perform various API calls to modify the graphical program, e.g., by adding one 
or more objects to the graphical program, changing connections between graphical 

15 program objects, changing various properties of graphical program objects, etc. 

It is noted that Figure 4 represents one embodiment of a method for 
programmatically generating a graphical program, and various steps may be added, 
reordered, combined, omitted, modified, etc. For example, as described above, the GPG 
program may include or may be associated with an application that the user uses to 

20 specify the program information. For example, such an application may enable the user 
to specify a state diagram, a test executive sequence, a prototype, etc., on which to base 
the graphical program. Thus, executing the GPG program in step 206 may comprise 
invoking a routine or program associated with this application, e.g., in response to the 
user selecting a menu option included in the application's user interface. In other 

25 embodiments, the user may launch the GPG program as an independent application. 
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Figure 5 - Examples of GPG Programs and Received Information 

Figure 5 is a block diagram illustrating that the GPG program may be a program for 
any of various purposes and may receive information of any type to use in generating a 
graphical program. Figure 5 illustrates a GPG program 250 and various types of program 
5 information 252 that the GPG program may receive. 

In some embodiments, the GPG program 250 may include or be coupled with a 
program or application which a user utilizes to construct or characterize a computational 
process. In response to the specified computational process, the GPG program 250 may 
programmatically generate a graphical program to implement the computational process. 

10 For example, a state diagram editor may be used to construct a state diagram 

characterizing a computational process, e.g., in response to user input. As shown in 
Figure 5, the GPG program 250 may then receive state diagram information 252A and 
use this state diagram information to programmatically generate the graphical program. 
For example, the programmatically generated graphical program may implement 

15 functionahty specified by the state diagram created by the user. 

As another example, the GPG program 250 may include or be coupled with a 
program or application which a user utilizes to construct a prototype, e.g., in order to 
characterize an algorithm at a high level. The constructed prototype may be represented 
as prototype information 252B. In this case, the GPG program 250 may then 

20 programmatically generate a graphical program that implements the prototype, based on 
the prototype information 252B. For more information on programmatically generating a 
graphical program to implement a prototype, please see U.S. Patent AppUcation Serial 
No. 09/595,003, incorporated by reference above. 

As another example, the GPG program 250 may include or be coupled with a 

25 program or application which a user utilizes to construct a test executive sequence, e.g., 
to perform a series of tests on a unit under test. In this case, the GPG program 250 may 
then programmatically generate a graphical program operable to perform the series of 
tests when executed, based on test executive sequence information 252C. 
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In other embodiments, the GPG program 250 may be associated with a program 
or appUcation that directly aids the user in creating a graphical program. For example, 
the GPG program 250 may be associated with a graphical programming development 
environment application. In this case, the GPG program 250 may be operable to receive 
5 user input specifying desired functionality, indicated as user interface wizard information 
252D in Figure 5, and may automatically, i.e., programmatically, add a portion of 
graphical program code implementing the specified functionality to the user's program. 
For example, the user interface wizard information 252D may be received via one or 
more "wizard" user interface dialogs enabling the user to specify various options. Such 

10 graphical program code generation wizards may greatly simplify the user's task of 
implementing various operations. As an example, it is often difficult for developers of 
instrumentation applications to properly implement code to analyze an acquired signal, 
due to the inherent complexity involved. By enabling the developer to specify the desired 
functionality through a high-level user interface, the developer can quickly and easily 

15 create graphical code to implement the signal analysis. Furthermore, since the graphical 
code is generated programmatically, the code may be optimized, resulting in an efficient 
program and a readable block diagram without unnecessary code. 

In other embodiments, the GPG program 250 may be operable to automatically 
translate an existing program into a graphical program. The GPG program may examine 

20 the existing program and programmatically generate a graphical program. In one 
embodiment, the GPG program may include or interface with different fi^ont-end plug-in 
modules, wherein each plug-in module is operable to analyze a particular type of 
program, e.g., a program written in a particular language or used by a particular 
development environment, and generate existing program information 252E usable by the 

25 GPG program for creating a graphical program that implements functionality of the 
existing program. The programmatically generated graphical program may perform the 
same, or substantially the same functionally as, or a subset of the functionality of the 
existing program. 
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In one embodiment, the existing program may be a text-based program, such as a 
C program. In another embodiment, the existing program may itself be a graphical 
program. For example, although graphical programs created using different graphical 
programming development environments are similar in some respects, the graphical 
5 programs typically cannot be easily transferred across different graphical programming 
environments for editing or execution. For example, different graphical programming 
development environments provide different nodes for inclusion in a block diagram, store 
program files in different formats, etc. Thus, if an existing graphical program associated 
with one programming environment is desired to be ported to a new programming 
10 environment, the GPG program may examine the existing graphical program (or may 
examine abstract information specifying the existing graphical program) and may 
programmatically generate a new graphical program associated with the new 
programming environment. 

In another embodiment, the GPG program 250 may be operable to automatically 
15 generate a graphical program in response to algorithm information 252F. 

In addition to the examples given above, a GPG program 250 may receive any 
other type of information and programmatically generate a graphical program based on 
the received information. 

It is noted that, in various embodiments, the GPG program 250 may receive the 
20 information 252 used in generating the graphical program in any of various ways. The 
information may be received from the user, from another program, or from other sources, 
such as a file or database. The information may comprise information of any type, 
including text or binary information structured in any of various ways. The information 
may be self-describing, and/or the GPG program may include knowledge of how to 
25 interpret the information in order to generate the appropriate graphical program. 

As an example, consider a state diagram editor application usable for constructing 
a state diagram. In this example, the GPG program may be or may be included in the 
state diagram editor application itself. For example, the state diagram editor application 
may receive user input specifying state diagram information. The state diagram editor 
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application may then progranunatically generate a graphical program to implement 
functionality specified by the state diagram information, e.g., in response to the user 
selecting a menu option to generate the graphical program. In other embodiments, the 
GPG program may be separate from the state diagram editor application. For example, 
5 when the user selects the menu option to generate the graphical program, the state 
diagram editor application may provide the state diagram information to another 
application, i.e., the GPG program, which then generates the graphical program based on 
this information. In another embodiment, a user may invoke the GPG program separately 
and request the GPG program to generate a graphical program, e.g., by specifying a state 

10 diagram file. The GPG program may receive the state diagram information in any of 
various ways formats, e.g., as binary data, XML data, etc. 

In most of the examples given above, functionality of the graphical program to be 
generated is specified explicitly by the received information. For example, a state 
diagram, user input specified via a wizard interface, a prototype, a test executive 

15 sequence, and an existing program, all explicitly specify, to varying degrees, functionality 
which the graphical program should implement. 

It is noted that in other embodiments the received information by itself may not 
explicitly or inherently specify functionality of the graphical program to be generated. In 
a case such as this, the functionality of the generated graphical program may be 

20 determined mainly by the GPG program. Thus, one embodiment may include different 
"types" of GPG programs, wherein each type of GPG program is configured to generate 
graphical programs of a certain type. For example, consider two different GPG 
programs, program A and program B, which are both operable to retrieve numeric data 
from a database and create a graphical program based on the numeric data. Program A 

25 may be operable to create a graphical program which, when executed, displays a user 
interface to visually graph the numeric data. For example, program A may receive user 
input specifying various display options desired and may programmatically generate the 
graphical program such that the graphical program is operable to display the numeric data 
as specified by the user. Program B, on the other hand, may be operable to create a 
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graphical program which, when executed, performs a statistical analysis of the data and 
displays the result of the analysis. For example, program B may receive user input 
specifying various analysis options desired and may programmatically generate the 
graphical program such that the graphical program is operable to analyze the numeric 
5 data as specified by the user. Thus, in these examples, the functionality of the graphical 
program is determined mainly by the GPG program that generates the graphical program, 
and only determined to a small degree by the received information. 

Thus, in various embodiments, the functionality of the graphical program may be 
determined by the received program information, and/or the GPG program, and/or 

10 possibly also in response to user input received by the GPG program. In some cases the 
functionality may be specified almost entirely by the received information. For example, 
in a case where the GPG program programmatically translates an existing program to a 
new graphical program, the functionality of the new graphical program may be specified 
entirely by the existing program. In other cases, the received information and the GPG 

15 program may each determine a portion of the functionality. For example, in a case where 
the GPG program generates a graphical program to implement a test executive sequence, 
the test executive sequence information may determine the body of the program which 
includes the code for executing the tests, but the GPG program may be operable to add 
additional functionality to the graphical program, e.g., by adding code operable to prompt 

20 the user for a log file and save test results to the log file, code to display a user interface 
indicating the current unit under test and the current test being performed, etc. 

In a typical case, the implementation of the graphical program code is determined 
mainly or entirely by the GPG program, although the received information may influence 
the manner in which the GPG program generates the code, or the GPG program may 

25 receive separate information influencing the code generation. For example, consider a 
GPG program operable to translate an existing graphical program to a new graphical 
program, e.g., in order to port the existing graphical program to a new programming 
environment. In one embodiment, the GPG program may be operable to generate the 
new graphical program in such a way as to match the existing graphical program as 
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closely as possible in appearance. In other words, the new graphical program may be 
generated so that when the user sees the block diagram of the new graphical program, the 
block diagram appears substantially the same as the block diagram of the existing 
graphical program, e.g., in terms of the layout and connections among the block diagram 
5 nodes. In another embodiment, the GPG program may be operable to implement the new 
graphical program differently, e.g., by optimizing the code where possible. In this 
example, the functionality of the generated graphical program may be the same in either 
case, but the graphical program may be implemented in different ways. 

The GPG program may also receive input specifying how to implement the 

10 graphical program. For example, in the case above, the user may specify whether or not 
to perform optimizations when translating an existing graphical program. For example, 
the new programming environment may support downloading the generated graphical 
program to a hardware device for execution. If the user desires to download the 
generated graphical program to a hardware device, e.g., for use in a real-time application, 

15 then it may be important to optimize the new program. Otherwise, it may be more 
important to implement the generated graphical program similarly as the existing 
graphical program is implemented. 

In one embodiment, the GPG program may provide extended support for 
specifying graphical program code implementation, beyond the ability to specify simple 

20 options. For example, the GPG program may support plug-ins specifying code 
generation information for various cases. Referring again to the program translation 
example above, each plug-in may specify how to generate code intended for execution on 
a particular hardware device. For example, if the generated program is to be run on an 
FPGA, the generation of the code may be optimized depending on the number of gates 

25 available on that particular FPGA. 

In various embodiments, an association between a generated graphical program 
and the received program information used in generating the graphical program may be 
maintained. For example, this association may enable a user to execute the automatically 
generated program and then retum to an application from which the program information 
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originates, e.g., in order to view or edit the program information. For example, consider a 
prototyping environment application which enables a user to develop a prototype 
characterizing an algorithm. The prototyping environment application may 
programmatically generate a graphical program implementing the developed prototype. 
5 The user may then execute the graphical program, and if a problem with the program is 
discovered, the association may enable the user to retum to the prototyping environment 
application in order to view or modify the prototype used to generate the program. Li one 
embodiment, a generated program may be "locked", requiring the user to explicitly 
unlock the program before the program can be modified within the graphical 

10 programming environment. Locking the program may facilitate the retrieval or recreation 
of the program information that was used to generate the program. 

In various embodiments, the GPG program may be operable to generate any of 
various types of graphical programs. For example, as discussed above, a generated 
graphical program may be targeted toward a particular graphical programming 

15 development environment application, e.g., to utilize proprietary features or to create files 
that are formatted in a manner expected by the graphical programming development 
environment. Examples of graphical programming development environments include 
Lab VIEW, Bridge VIEW, DasyLab, and DiaDem from National Instruments, VEE from 
Hewlett Packard, Simulink from The MathWorks, Soflwire from Measurement 

20 Computing, Inc., Sanscript from Northwoods Software, WiT from Coreco, and Vision 
Program Manager from PPT Vision, among others. 

In various embodiments, the graphical program may be generated using any of 
various methods or techniques. Generating the graphical program may comprise generating 
one or more files defining the graphical program. When a user interactively develops a 

25 graphical program from within a graphical programming environment, the graphical 
programming environment may create one or more program files. For example, the 
program files may specify information such as a set of nodes that the graphical program 
uses, interconnections among these nodes, programmatic structures such as loops, etc. In 
other cases, the program files may store various data structures, e.g., in binary form, which 



Atty. Dkt No.: 5150-44100 



Page 37 



Conley, Rose & Tayon, P.C. 




the graphical programming enviromnent uses to directly represent the graphical program. 
Thus, in programmatically generating the graphical program, the GPG program may 
programmatically generate one or more files representing the graphical program, wherein 
these files are structured or formatted appropriately for a particular graphical programming 
5 environment. 

In various cases, a graphical program generated by a GPG program in response to 
program information may be a fiilly working program. Thus, the user may load the 
generated graphical program into the graphical programming environment, execute the 
program, etc. hi other cases, the generated graphical program may not be a complete 

10 program. As an example, if an existing program is translated to a graphical program, it may 
not be possible to translate the entire program. For example, the existing program may 
utilize fimctions which do not exist in the graphical programming environment to which the 
program is to be ported. However, the GPG program may still create a partial graphical 
program, making it relatively easy for the user to complete the graphical program. In still 

15 other cases, it may be desirable to programmatically generate only a graphical code portion, 
e.g., as discussed above in the case of user interface wizard tools that aid the user in 
program development. 



20 Figure 6 - GPG Program Accesses Server Program Through an API 

As described above, in one embodiment, the GPG program may be implemented as 
a client program and a server program, wherein the server program may provide an 
application programming interface (API) which the client program can use to 
programmatically generate the graphical program. One embodiment of such a client/server 

25 implementation of a GPG program is described below. 

For each node, user interface element, or other object of the graphical program, the 
client program may call the API to programmatically add the object to the graphical 
program, connect the object to other objects of the graphical program, etc. Any necessary 
files or other constructs needed by the graphical programming environment in order to use 
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the generated graphical program may be automatically created by the server program as a 
result of calling the API. 

Figure 6 is a block diagram illustrating the abstract relationship between a client 
program 502, an API 504 to programmatically create/edit a graphical program, and a 
5 server program 506. It is noted that the API block represents the abstract notion of the 
API presented by the server program 506, and in various embodiments the API block 504 
may not represent any actual code. Also, in actual embodiments, various layers may exist 
which implement the elements of the Figure 6 relationship. For example, the client 
program 502 may be a part of a larger software appUcation, the server program 506 may 
10 receive information sent by the client program 502 via an intermediate server, etc. 
sj^i^^f^ As^fiotgdabove, the chent program 502 may be any of various types of programs. 
For example, the clienrpr3gram.,552may be a graphical program. The client program 
502 may also be a text-based program such as a-Ci+program, a Visual Basic program, a 
Java program, etc., or any combination of these or other l^Iguaggs. The cUent program 
15 502 may execute independently or may execute within an execution subsystem^ of an 
application development environment. 

The client program 502 may call the API 504 in any of various ways. For 
example, a client graphical program may include graphical nodes corresponding to the 
API 504. One embodiment of a set of graphical nodes which a client graphical program 
20 may utilize to create/edit a graphical program is described in detail below. A client 
graphical program may also interface with text-based code which calls the API 504. 

The client program 502 may also call the API 504 in various other ways. For 
example, the server program 506 may expose a component such as an ActiveX 
component, CORBA component, JavaBeans component, etc., and the client program 502 
25 may obtain a reference to the object to invoke functions or methods of the API 504. The 
API 504 may also be integrated with the language or development environment of the 
client program 502, e.g. as a library. 

Through the API 504, the client program 502 may communicate with the server 
program 506. The server program 506 is operable to perform the actions indicated by the 
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API calls. For example, the server program may be operable to create a new graphical 
program, add objects to the graphical program, comiect graphical program objects, etc. 
The server program 506 is preferably an instance of a graphical programming 
environment. In one embodiment, the server program 506 is an instance of the Lab VIEW 

5 graphical programming environment. One particular embodiment of the server program 
506 is described below. 

In one embodiment, the server program 506 is the same regardless of the type of 
information (e.g., 252A - 252F) that is received. Typically, the client program 502 will be 
different (or will use a different plug-in) based on the type of information, e.g. 252A - 

10 252F. Also, it is noted that the GPG program may be considered to be only the client 
program 502, wherein in this instance the GPG program 502 simply uses the services of a 
separate server program. 



15 Graphical API 

The server program 506 of Figure 6 may be operable to receive requests to 
generate/edit a graphical program from a client program 502 and perform the actual 
operations of creating/editing the graphical program. Thus, in the preferred embodiment, 
the client program 502 includes program logic for processing received program 

20 information and determining the structure of a graphical program to be generated based 
on the received program information, and the client program calls the server program to 
perform the generation of the graphical program (or to perform a modification to an 
existing graphical program). 

In one embodiment, the server program 506 of Figure 6 is an apphcation instance 

25 of the Lab VIEW graphical programming environment. As noted above, the Lab VIEW 
environment provides specialized support for developers of instrumentation and industrial 
automation applications, and a Lab VIEW graphical program may be referred to as a virtual 
instrument or VL The Lab VIEW environment comprises functionality referred to as "VI 
Server" which enables client programs to communicate with the Lab VIEW environment. 
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The VI Server functionality enables client programs to create or edit a Lab VIEW graphical 
program or VL 

A chent program which requests Lab VIEW to generate/edit a VI may itself be a 
graphical program or VL A chent VI may include particular nodes in the client VI block 
5 diagram which utilize the VI Server functionality of a Lab VIEW instance to request the 
Lab VIEW instance to obtain information of an existing VI, create a new VI, add objects to 
the VI, etc. These nodes are described below with reference to Figures 7-17, and Figures 
21-23 illustrate exemplary uses of these nodes. (Lab VIEW also provides components 
such as ActiveX components which enable text-based programs such as Visual Basic 
10 programs. Visual C++ programs, etc. to access the VI Server functionality. In the preferred 
embodiment, these components enable text-based programs to perform all of the functions 
described below.) 

15 Figures 7-17: Client Graphical Program Nodes 

Figure 7 - Open Application Reference Node 

Figure 7 illustrates the Open Application Reference node. A client VI may 
include the Open Application Reference node to obtain a reference to a VI Server 
20 application running on the specified computer. If an empty string is specified for 
machine name, then the node returns a reference to the local Lab VIEW application in 
which this function is running. If a machine name is specified, then the node attempts to 
establish a TCP connection with a remote VI Server on that machine on the specified 
port. 

25 The application reference output can be used as an input to the Property and 

Invoke nodes described below to get or set properties and invoke methods on the 
application. The application reference output is used as the input to the Open VI 
Reference function to obtain references to Vis in that application. The reference is closed 
with the Close Application or VI Reference function. If the user forgets to close this 
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reference, the reference closes automatically when the top level VI associated with this 
function finishes executing. However, closing the reference operates to conserve the 
resources involved in maintaining the connection. 

The following describes the inputs and outputs of the Open Application Reference 

5 node: 

machine name is the address of the computer that runs a copy of Lab VIEW to 
which it is desired to establish a connection. This address can be in dotted decimal 
notation (such as 130.164.15.250) or domain name notation (such as foo.natinst.com). An 
empty string will cause this function to retum a reference to the local Lab VIEW. The 
10 machine name input enables client programs to communicate with a VI Server instance 
running on any computer connected to the Internet. 

port number is the port on which the remote Lab VIEW application is listening. 
If port number is not wired, the default VI Server listener port number (e.g., 3363) is 
used. 

15 error in describes error conditions that occur prior to the execution of this 

function. The default input of this cluster is "no error". If the error Boolean of this cluster 
is True, the Open Application Reference function will do nothing but pass through the 
error via the error out output. 

application reference is the reference to the specified application. 

20 error out contains error information. If error in indicates an error, error out 

contains the same error information. Otherwise it describes the error status that this 
function produces. 



25 Figure 8 - Open VI Reference Node 

Figure 8 illustrates the Open VI Reference node. The Open VI Reference node 
retums a reference to a VI specified by a name string or path to the VPs location on disk. 
This reference may then be used to edit the VI. In the current embodiment, references 
can only be obtained to standard Vis. This excludes Control, Typedef, and Global Vis. 
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In the preferred embodiment, the Open VI Reference node can be used to obtain a 
reference to any VI. 

References to Vis in another Lab VIEW application are obtained by wiring an 
application reference (obtained from the Open Application Reference function) to this 
5 function. In this case, the path input refers to the file system on the remote Lab VIEW 
computer. If a reference to the local Lab VIEW application is wired the same behavior is 
obtained as if nothing had been wired to the application reference input. 

If editing operations are to be performed on the referenced VI, and the VI has a 
password-protected diagram, the password is provided to the password string input. If 
10 the incorrect password is provided, the Open VI Reference function returns an error and 
an invalid VI reference. If no password is provided when opening a reference to a VI that 
is password protected, the reference can still be obtained, operations can only be 
performed that do not edit the VI. 

If the specified VI is to be called through the Call By Reference function, a 
15 strictly-typed VI reference is wired to the type specifier input. The function ignores the 
value of this input. Only the input's type - the connector pane information - is used. By 
specifying this type, the Open VI Reference function verifies at run time that the 
referenced VFs connector pane matches that of the type specifier input. 

If a Generic VI refiium type is wired to the type specifier input, this results in the 
20 same behavior as if the type specifier input had not been wired at all. 

If the type specifier input is wired with a strictly-typed VI refiium, the VI must 
meet several requirements before the VI reference is returned successfully: 

1) The VI cannot be broken for any reason. 

2) The VI must be runnable as a sub VI, that is, it cannot be active as a 
25 top-level VI (unless the VI is re-entrant). 

3) The connector pane of the VI must match that of the type specifier. 

If the user forgets to close this reference using a close reference node, the 
reference closes automatically when the top-level VI associated with this function 
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finishes executing. However, closing the reference operates to conserve the resources 
involved in maintaining the connection. 

If a strictly-typed reference to a reentrant VI is obtained, a dedicated data space is 
allocated for that reference. This data space is preferably always used and is used only in 
5 conjunction with the output VI reference. This can lead to some new behaviors in 
Lab VIEW. For example, parallel calls (using the Call By Reference node) to a reentrant 
VI using the same VI reference do not execute in parallel, but executes serially, one after 
the other. As another example, a reentrant VI could get a reference to itself (allocating a 
new data space) and call itself recursively through the Call By Reference node. It is 
10 noted that allocating a data space dynamically is both time consuming and memory 
consuming and is not generally recommended for implementing recursive algorithms. 

A VI reference is similar to what is known as a function pointer in other 
languages. However, in Lab VIEW, these function pointers also can be used to reference 
Vis across a network. 

15 The following describes the inputs and outputs of the Open VI Reference node: 

application reference is a reference to a Lab VIEW application. If this input is 
left unwired, the reference is to an application on the local version of Lab VIEW. If the 
input is wired, and the reference is to a remote version of Lab VIEW, then the remote 
Lab VIEW is queried to return the VI reference. 

20 type specifier is used for its data type only. The value of the input is ignored. The 

data type of the type specifier input determines the data type of the vi reference output. 

VI name or path is poljmnorphic and can accept a string containing the name of 
the desired VI, or a path containing the complete path (including the name) to the desired 
VI. If a name string is wired, then the VI must already be in memory. If a path is wired 

25 and the VI is aheady in memory, the VI in memory is obtained, whether its path is the 
same as the input or not. If the VI is not in memory, then the VI must be at the specified 
path for this function to succeed. If the VI is at that location, the VI is loaded into 
memory. 
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error in describes error conditions that occur prior to the execution of this 
function. The default input of this cluster is no error. 

password is the plain-text password string for the VL If the VI is not password 
protected, the input is ignored. If the VI is password protected and an incorrect password 
5 is entered, the VI can be referenced, but the VI cannot be edited through that VI 
reference. 

vi reference is the re&um associated with the requested VI. If the function fails, 
"not-a-refiium" is returned. 

error out contains error information. If error in indicates an error, error out 
10 contains the same error information. Otherwise error out describes the error status that 
this VI produces. 

If the user specifies a remote version of Lab VIEW by the application reference 
input, the path is interpreted on the remote machine in the context of the remote file 
system. The path is expressed using the local computer's path separators, but is translated 
15 to the remote computer's path separators when the request arrives there. For example, to 
reference a VI on a Macintosh at My HD:LabVIEW VIs.foo.vi from a Windows 
application, the Window's path syntax: My HD:\LabVIEW VIs\fooM would be used. 
Conversely, to reference a VI on a Windows computer at C:\labview\foo.vi from a 
Macintosh application, the Macintosh path syntax: C:labview:foo.vi would be used. 

20 

Figure 9 - New VI Reference Node 

Figure 9 illustrates the New VI Reference node. The New VI Reference node 
creates a new VI and outputs a reference to the new VI. The following describes the 
25 inputs and outputs of the New VI Reference node: 

application reference is an input reference to a local or remote LabVIEW 
application. Such a reference may be obtained from the Open Application Reference 
node. If this input is left unwired, the reference is to an application on the local version 
of LabVIEW. 
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template is a path of or reference to an existing VI to be used as a template for the 
new VL If the template input is wired, the new VI will be a copy of the template VL 

vi type specifies the type of VI to create. The possible types are: standard VI, 
global VI, or control VL 
5 error in describes error conditions that occur prior to the execution of this 

function. The default input of this cluster is no error. 

password is the password input for the template VI, if a password-protected VI is 
wired to the template input. If the template VI is not password protected, the password 
input is ignored. 

10 vi reference is the refiium associated with the newly created VI. If the function 

fails, "not-a-refiium" is returned. 

error out contains error information. If error in indicates an error, error out 
contains the same error information. Otherwise error out describes the error status that 
this node produces. 

15 

Figure 10 - Open VI Object Reference Node 

Figure 10 illustrates the Open VI Object Reference node. The Open VI Object 
Reference node outputs a reference to an object contained in a VL The following 
20 describes the inputs and outputs of the Open VI Object Reference node: 

vi object class specifies the type of object reference to obtain. References to both 
objects of a front panel (user interface panel) and of a block diagram may be obtained. 
Figure 19 illustrates how a user may choose a value for the vi object class input by 
selecting fi"om a hierarchical menu. For example, a "slide" value may be chosen to 
25 designate that the reference to obtain is a reference to a slide user interface control. 

owner reference is an input reference to the object that "owns" or "contains" the 
object for which a reference is to be obtained. The owner reference may be a reference to 
a VI or to an object within a VI. For example, the owner reference may be a reference to 
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a block diagram node, and the reference to be obtained may be a reference to an input 
terminal of the block diagram node. 

name/order identifies the name or order, e.g. zplane order, of the object for which 
to obtain a reference. The name/order input may be a simple string, an array of strings, or 
5 a numeric constant. An array of names may be used if the object is a nested object. For 
example, to access the status boolean of an error cluster in an array called "my Array", the 
name array may be: ["my Array", NULL, "status"]. 

error in describes error conditions that occur prior to the execution of this 
function. The default input of this cluster is no error. 
10 object reference is an output reference to the object specified by the node inputs. 

If the function fails, "not-a-refiium" is returned. 

error out contains error information. If error in indicates an error, error out 
contains the same error information. Otherwise error out describes the error status that 
this node produces. 

15 

Figure 1 1 - New VI Object Reference Node 

Figure 11 illustrates the New VI Object Reference node. The New VI Object 
Reference node creates a new VI object and outputs a reference to the new VI object. 

20 The following describes the inputs and outputs of the New VI Object Reference node: 

auto wire is a boolean input specifying whether to automatically wire the 
terminals of the new object with compatible terminals of a source object. This input is 
only applicable for diagram objects, not user interface objects. If this input is wired, then 
the position/next to input should also be wired. 

25 vi object class specifies the type of object to create. Both objects for a front panel 

(user interface panel) and for a block diagram may be created. Figure 19 illustrates how a 
user may choose a value for the vi object class input by selecting from a hierarchical 
menu. For example, a "slide" value may be chosen to designate that the reference to 
obtain is a reference to a slide user interface control. 
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owner reference is a reference to the VI or VI object that will "own" or "contain" 
the new object. For example, the owner may be the VI, and the new object may be a new 
function node to add. 

style specifies the style or sub-class of object to create. Figure 20 illustrates how 
5 a user may choose a value for the style input by selecting from a hierarchical menu. For 
example, if "slide" is chosen as the vi object class input, then "vertical pointer slide" 
may be chosen for the style input. The style input is ignored if the path input is wired. 

position/next to specifies a position for the new object. An X-Y coordinate pair 
may be wired to this input, or a reference to an existing object may be wired. If an object 
10 reference is wired in, then the new object is positioned next to the referenced object. 

error in describes error conditions that occur prior to the execution of this 
function. The default input of this cluster is no error. 

path specifies the location of a user controWI. 

bounds specifies the size of the new object. The bounds input is ignored for 
15 fixed-size objects. 



Figure 12 - Upcast Reference Node 

Figure 12 illustrates the Upcast Reference node. The Upcast Reference node casts 
20 the type of a reference to an object to the type of a superclass for the object. The 
following describes the inputs and outputs of the Upcast Reference node: 
vi object reference specifies a VI object reference to upcast, 
vi object class specifies a class to cast the object reference to. Figure 19 
illustrates how a user may choose an object class from a hierarchical menu. For example 
25 a reference to a vertical pointer slide object may be upcasted to a reference to a general 
sHde object. 

upcasted reference is an output reference with the specified class as the reference 
type information. If the upcast fails, "not-a-refhum" is the output value. 
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Figure 13 - Downcast Reference Node 

Figure 13 illustrates the Downcast Reference node. The Downcast Reference 
node casts the type of a reference to an object to the type of a subclass. The following 
5 describes the inputs and outputs of the Downcast Reference node: 

vi object reference specifies a VI object reference to downcast, 
vi object class specifies a class to cast the object reference to. Figure 20 
illustrates how a user may choose a class firom a hierarchical menu. For example a 
reference to a general slide object may be downcasted to a reference to a vertical pointer 
10 slide object. 

error in describes error conditions that occur prior to the execution of this 
fianction. The default input of this cluster is no error. 

downcasted reference is an output reference with the specified class as the 
reference type information. If the downcast fails, "not-a-refiium" is the output value. 
15 error out contains error information. If error in indicates an error, error out 

contains the same error information. Otherwise error out describes the error status that 
this node produces. 



20 Figure 14 - Close Application or VI Reference Node 

Figure 14 illustrates the Close Application or VI Reference node. The Close 
Application or VI Reference node closes an open VI or the connection to a Lab VIEW 
application instance. The following describes the inputs and outputs of the Close 
Application or VI Reference node: 
25 application or vi reference is the refiium associated with an open VI or a 

Lab VIEW appUcation instance. 

error in describes error conditions that occur prior to the execution of this 
function. The default input of this cluster is no error. 
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error out contains error information. If error in indicates an error, error out 
contains the same error information. Otherwise it describes the error status that this node 
produces. 

5 

FiRure 15 - Call By Reference Node 

Figure 15 illustrates the Call By Reference node. The Call By Reference node 
may be used to call a VI, such as a VI which has been created programmatically. The 
Call By Reference node is similar to a sub-VI node in that either can be used to call a VL 

10 However, a sub-VI node is statically linked to a particular VI that the user determines 
when he/she drops the node on the diagram. With the Call By Reference node, the VI 
that is called is determined dynamically at run time by the value of the VI reference wired 
to the reference input at the top of the node. Thus, the VI which is called by the Call By 
Reference node may be on a different computer. 

15 The top of the Call By Reference node includes four terminals: an input/output 

pair of flow through VI reference terminals, and an input/output pair of flow through 
error clusters. The VI reference input accepts wires only from strictly-typed VI 
references. Below these terminals is an area within which a connector pane resides (is 
displayed) that is identical to that of a VI with its terminals showing (rather than its icon). 

20 The connector pane of the strictly-typed VI reference input determines the pattern and 
data types of this connector pane which is displayed in the Call By Reference node icon. 
The user wires to these terminals just as he/she would to a normal sub-VI. 

As long as none of the terminals of the connector pane have wires attached to 
them, the connector pane will adapt automatically to that of the input VI reference's 

25 connector pane. However, if any of them are wired, the node does not adapt 
automatically, and the user must explicitly change the connector pane (possibly breaking 
those wires) by popping up on the node and selecting the Adapt To Reference Input 
menu item. 
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At run time there is a small amount of overhead in calling the VI that is not 
necessary in a normal sub- VI call. This overhead comes from validating the VI reference 
and a few other bookkeeping details. However, for a call to a VI in the local Lab VIEW, 
this overhead should be insignificant for all but the smallest sub Vis. Calling a VI located 
5 in another Lab VIEW application (across the network) may involve more overhead. 

The following describes the inputs and outputs of the Call By Reference node: 

vi reference is the refiium associated with a VI that is already open. 

error in describes error conditions that occur prior to the execution of this 
function. The default input of this cluster is no error. 
10 dup reference has the same value as reference. 

error out contains error information. If error in indicates an error, error out 
contains the same error information. Otherwise, it describes the error status that this VI 
produces. 



15 

Figure 16- Property Node 

Figure 16 illustrates the Property node. The Property node sets (writes) or gets 
(reads) application, VI and VI object property information. Thus, the Property node may 
be used to create/edit a graphical program. For example, the property node may be used 

20 to change the color of a user interface object, etc. 

To select a specific property, the user pop ups on one of the name terminals and 
selects Properties. The list of available properties to select from may depend on the type 
of object wired to the reference input. To set property information, the user pop ups and 
selects Change to Write. To get property information the user pop ups and selects 

25 Change to Read. Some properties are read only, so Change to Write cannot be seen in 
the popup menu. If the user desires to add items to the node, the user pop ups and selects 
Add Element or cHcks and drags the node to expand the number of items in the node. 
The properties are changed in the order from top to bottom. If an error occurs on one of 
the properties, the node stops at that property and returns an error. In this case, no fiirther 
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properties are handled. The error string reports which property caused the error. If the 
small direction arrow on a property is on the left, then the property value is being set. If 
the small direction arrow on the property is on the right, the user is getting the property 
value. Each property name has a short or long name which can be changed by popping up 
5 and selecting Name Format. Another name format is no name where only the type is 
displayed for each property. 

The Property node may be used to access or affect a number of different properties, 
including VI (virtual instrument) and application properties. 

The inputs and outputs of the Property node are described below. 
10 reference is the refhum associated with a VI object, VI, or a Lab VIEW 

application instance. 

error in describes error conditions that occur prior to the execution of this 
fimction. The default input of this cluster is no error. 

dup reference has the same value as reference. 
15 error out contains error information. If error in indicates an error, error out 

contains the same error information. Otherwise error out describes the error status that 
this node produces. 



20 Figure 17 - Invoke Node 

Figure 17 illustrates the Invoke node. The Invoke node invokes a method or 
action on a VI or VI object. Thus, the Invoke node may be used to create/edit a graphical 
program. For example, a method may be invoked on a block diagram node to reposition 
the node, wire the node to another node, etc. Most methods have parameters associated 

25 with them. To select the method, the user pops up anywhere on the node and select 
Methods. Once the user selects the method, the associated parameters appear in the node, 
as shown in Figure 17. The number of parameters shown may vary, depending on which 
method is selected. Each parameter may have an input terminal, output terminal, or both. 
An output terminal may be present for the retum value of the method. The Invoke node 
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may be used to invoke a number of different methods, including VI (virtual instrument), 
VI object, and application methods. 

The inputs and outputs of the Invoke node are as follows: 

reference is the refiium associated with a VI object, VI, or application on which 
5 the user desires to perform an action. 

error in describes error conditions that occur prior to the execution of this 
function. The default input of this cluster is no error. 

dup reference has the same value as reference. 

error out contains error information. If error in indicates an error, error out 
10 contains the same error information. Otherwise error out describes the error status that 
this node produces. 



Figure 18 - VI Server Refiium Controls 

15 Figure 18 illustrates user interface controls which may be placed on a front panel 

in order to interactively obtain a reference, such as a reference to a VI or an object of a 
VI. Figure 18 illustrates exemplary fi-ont panel refiium controls for Application, Generic 
VI, and Strictly-typed VI data types. It is noted however, that a graphical programming 
system may provide such front panel refiium controls for any of the various objects 

20 associated with a VI, including terminals, etc. As shown in Figure 18, the image in each 
refiium icon indicates the type of the refiium. 

As shown in Figure 18, VI references may be sub-divided into two classes of Vis: 
the Generic VI and the Strictly typed VI. In general, a Generic VI reference is used to 
perform editing operations (e.g., setting properties or invoking functions) on any VI, and 

25 a Strictly-typed VI reference is used to call a dynamically loaded VI as a sub-VI, and to 
perform operations that do not edit or change the VL The Application class refiium icon 
displays the Lab VIEW application icon. The Generic VI class refiium icon displays the 
VI file icon. The Strictly-typed VI class refiium icon depicts the connector pane that 
defines the class. 
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A front panel refrium provides a reference to an appropriate entity. Thus, the 
Apphcation refiium provides a reference to a graphical programming application, e.g. a 
Lab VIEW application, the generic VI refiium provides a reference to a generic virtual 
instrument or generic graphical program, and the strictly typed VI refiium provides a 
5 reference to a specified graphical program or VI. Other types of refiiums provide 
references to their corresponding graphical program objects. 

In the preferred embodiment, the user selects a VI Server front panel refiium 
control and places this refiium control in a front panel of a VI. The user then configures 
the refiium to be an appropriate type, such as an Application refiium, a Generic VI 
10 refiium, a Strictly-typed VI refiium, or another type of refiium. Once the user has 
configured the refiium control to the appropriate type, the refiium control takes on the 
respective appearance by the class selected by the user. For example, if the user drops the 
front panel refiium control on the front panel and configures the refiium to be of the 
Application class, the refiium takes on the Application icon appearance shown in Figure 



When the user drops or places the VI Server refiium in the front panel and 
configures the refiium, corresponding terminals appear in the block diagram. These 
terminals provide the information on the application or graphical program referenced by 
the refiium. 



Figures 21-23: Programmatic Graphical Program Creation Example 

Figure 23 illustrates an exemplary client graphical program that uses the nodes 
described above to create the graphical program illustrated in Figures 21 and 22. The client 
25 graphical program of Figure 23 may be created interactively by a user, as described above. 
Figures 21 - 23 are intended to be easily understandable examples illustrating the 
programmatic generation of a graphical program using the client graphical program nodes 
described above. In this example, the graphical program of Figure 23 is operable to always 
programmatically generate the same graphical program, i.e., the graphical program of 



15 



18. 



20 
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Figures 21-22. In other words, the graphical program of Figure 23 is "hardcoded" to 
generate the graphical program of Figures 21-22. In a more typical case, a GPG program 
may be operable to generate a plurality of graphical programs, wherein the graphical 
program that is generated depends on program information received or processed by the 
5 GPG program, as described above. 

Figure 21 illustrates a user interface panel which includes a waveform chart control 
and a button control. Figure 22 illustrates a block diagram representing the execution and 
data flow of the program. Each of the user interface controls of Figure 21 has a 
corresponding user interface node in the Figure 22 block diagram. The rectangular object 
10 610 with the arrowhead is a while loop. The icon 612 is the condition terminal for the while 
loop 610. 

When the program of Figures 21 - 22 is run, the graphical code shown within the 
while loop executes until the input to the condition terminal 612 becomes "false". As 
shown, the user interface node 614 for the stop button is connected to a boolean 'TSfot" 
15 function. By default, the output of the stop button user interface node 614 is "false*. When 
a user presses the stop button, the output of the node 614 becomes "true", and the input to 
the condition terminal 612 thus becomes "false". When this happens, the program 
terminates, since in this example there is no additional code to execute after the while loop 
ends. 

20 The icon 616 represents a random number generator function node. The output 

terminal of the random number function node 616 is connected to the input terminal of the 
waveform chart user interface node 618. Thus, for each iteration of the while loop, a 
random number is generated and plotted on the waveform chart user interface control. 
Figure 21 shows how the waveform chart may appear after several loop iterations. The icon 

25 620 is simply a "wait" function icon with an input constant of 100, which causes a pause of 
100 milliseconds for each loop iteration. 

Figure 23 illustrates a cUent graphical program which uses the nodes described 
above to programmatically create the graphical program of Figures 21 and 22. For clarity, 
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the client graphical program is broken into sections, and the function of each section is 
described. 

In section 1 of Figure 23, a New VI Reference node is used to create a new 
graphical program. Since no application reference is passed to the New VI Reference node, 
5 the new graphical program is created by the default local Lab VIEW application instance. 
The New VI Reference node outputs a reference to the new graphical program, and the 
Property node "reference" input receives this reference. As shown, the Property node sets 
various properties of the graphical program. For example, the origin and coordinate bounds 
of the user interface panel (front panel) are set, the coordinate bounds of the block diagram 
10 window are set, etc. As described above, a user may pop up a menu to select the desired 
property of an object to get or set. The list of displayed properties may vary according to 
what type of object the reference input references. 

In section 2 of Figure 23, a New VI Object Reference node is used to create the 
waveform chart user interface control. As shovra, the reference to the new graphical 
15 program generated by the New VI Reference node in section 1 is connected as the "owner 
reference" input of the New VI Object Reference node.. Other inputs are also connected 
which specify the type of object to create, the position to place the object, etc. Once the 
waveform control is created, the New VI Object Reference node outputs a reference to the 
waveform control The property node of section 2 receives this reference input and changes 
20 the Y axis range of the waveform control to range from 0.0 to 1 .0. 

In section 3 of Figure 23, a New VI Object Reference node is used to create the stop 
button user interface control. A positioning function is used to specify the position input for 
the node, in order to appropriately position the button under the waveform chart on the user 
interface panel. 

25 In section 4 of Figure 23, a New VI Object Reference node is used to create and 

position the while loop. 

In section 5 of Figure 23, an Open VI Object Reference node is used to obtain a 
reference to the user interface node on the block diagram corresponding to the waveform 
chart user interface control. As shown, a "Control Terminal" data type is specified as the 
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class of the object for which to obtain a reference, "Waveform Chart" is specified as the 
name of the object for which to obtain a reference, and the reference to the new graphical 
program is specified as the owner reference. Together, these inputs identify the waveform 
chart user interface node. Once the reference to the waveform chart user interface node is 
5 obtained, the reference is connected to the reference input of the Invoke node shown in 
section 5. The Invoke node invokes a "Move" method on the waveform chart user interface 
node, moving it into the area bounded by the while loop. As described above, a user may 
pop up a menu to select the desired method to invoke on an object. The list of displayed 
methods may vary according to what type of object the reference input references. 

10 In section 6 of Figure 23, a New VI Object Reference node is used to create the 

random number generator fimction. As shown, the reference to the while loop created in 
section 4 is used as the "owner reference" input of the New VI Object Reference node. 
Thus, the random number function is created within the while loop. 

In section 7 of Figure 23, an Invoke node is used to connect the random number 

15 generator function to the waveform chart user interface node. As shown, the reference to 
the waveform chart user interface node is connected to the reference input of the Invoke 
node. Once the user selects the "Connect Wire" method as the method to invoke, the 
Invoke node displays a list of relevant input parameters. As shown, the reference to the 
random number generator function node is supplied as the "wire source" input parameter. 

20 Thus, when the Invoke node invokes the "Connect Wire" method, the random number 
generator function node is connected to the waveform chart user interface node. 

In section 8 of Figure 23, a New VI Object Reference node is used to create a wait 
fimction node, an Open VI Object Reference node is used to obtain a reference to the 
"miUiseconds to wait" input terminal of the wait function node, and an Invoke node is used 

25 to create a numeric constant of 100 which is connected to the "milliseconds to wait" input 
terminal of the wait function node. 

In section 9 of Figure 23, the stop button user interface node is moved inside the 
area bounded by the while loop. Section 9 is similar to section 5 described above. 
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In section 10 of Figure 23, a New VI Object Reference node is used to create a 
'"Not" boolean function inside the while loop. Section 10 is similar to the sections 
described above. 

In section 11 of Figure 23, an Invoke node is used to connect the stop button user 
5 interface node to the Not function node. Section 1 1 is similar to section 7 described above. 

In section 12 of Figure 23, a Property node is used to obtain a reference to the loop 
condition terminal of the while loop. The reference to the condition terminal is connected 
as the reference input to the Invoke node shown in section 12, and the Invoke node connects 
the output of the Not function node to the condition terminal of the while loop, similarly to 
10 the sections described above. 

In section 13 of Figure 23, an Invoke node is used to run the newly created graphical 
program. As shovm, the reference to the new graphical program is connected to the 
reference input of the Invoke node, and a "Run" method is selected as the method to invoke 
on the program. Although omitted from the above description, error information is 
15 propagated through the Figure 23 client program, and the "error out" node shown in section 
13 receives the final error status of the program. 

Although this example is primarily concemed with creating a new graphical 
program, it is noted that the above-described functionality also enables programmatic 
editing of a graphical program. References to graphical program objects may be obtained, 
20 and various properties may be set and various methods may be invoked to move objects, 
resize objects, add/remove objects, reconnect objects, etc., similarly to the description 
above. In the preferred embodiment, any operation which a program developer may 
perform interactively may also be performed programmatically. 



Text-Based Client Program 

As described above, client programs may also be text-based programs. In the 
preferred embodiment, a text-based program may obtain a reference to a software 
component that includes an interface with functions or methods to perform operations 



25 
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similar to those performed by the nodes described above. For example, a program may 
obtain a reference to an ActiveX component, where the interface for the ActiveX 
component includes a CreateNewProgram method which is comparable to the New VI 
Reference node, a GetProgramObjectReference method which is comparable to the Open 
)bject Reference node described above, etc. 

Tn^-A^^^^greferred embodiment, various types of software components are provided 
which enable programs of various languages executing on various systems to 
programmatically create/edit graphi^al^programs. As is well known in the art, modem 
component-based software architecture and,^o^ject oriented design techniques make it 
10 relatively straightforward to encapsulate portions opcode and provide various interfaces to 
the code. For example, a service to create/edit a graphical program may be exposed as an 
ActiveX component, a CORBA component, a Java component, etc>s>hi one embodiment, 
the implementation of the nodes described above and the implementation of*eomponents for 
use in text-based programs may be based on a common code base. 
15 

Although the system and method of the present invention has been described in 
connection with the preferred embodiment, it is not intended to be limited to the specific 
form set forth herein, but on the contrary, it is intended to cover such altematives, 
modifications, and equivalents, as can be reasonably included within the spirit and scope 
20 of the invention as defined by the appended claims. 
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